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REMARKS 

Enclosed herewith is a Substitute Specification in which 
the specification as filed has been amended in various places to 
correct typographical and grammatical errors. In particular, the 
specification as filed has been amended to correct the numbering of 
the figures. 

In support of the above, enclosed herewith is a copy of 
the specification as filed marked up with the above changes. 

The undersigned attorney asserts that no new matter has 
been incorporated into the Substitute Specification. 

The claims have been amended to more clearly define the 
invention as disclosed in the written description. In particular, 
claims 1-6, 9, 26-30, 49 and 50 have been cancelled. Claim 7 has 
been made a proper independent claim and includes the limitations 
of claims 1-3, 5 and 6; claims 8, 10 and 11 have now been made 
dependent on claim 7; claims 13 and 14 have each been made proper 
independent claims and include the limitations of claims 1, 11 and 
12; claim 17 has now been made dependent on claim 13; claim 20 has 
been made a proper independent claim and includes the limitations 
of claim 1; claims 21 and 22 have now been made dependent on claim 
20; claims 23 and 24 have been made proper independent claims and 
include the limitations of claim 1; claim 31 has been made a proper 
independent claim and includes the limitations of claims 26, 27, 29 
and 30; claims 32-34 have now been made dependent on claim 31; 
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claims 36 and 37 have each been made proper independent claims and 
include the limitations of claims 26, 34 and 35; claim 40 has now 
been made dependent on claim 36; claims 43, 46 and 47 have each 
been made proper independent claims and include the limitations of 
claim 26; and claims 44 and 45 have now been made dependent on 
claim 43. In addition, the claims have been amended for clarity. 

The Examiner has rejected claims 1-4, 9, 10, 21, 26-28, 33 
and 44 under 35 U.S.C. 102(b) as being anticipated by U.S. Patent 
5,758,257 to Herz et al. The Examiner has further rejected claimsS, 
8, 17-19, 29, 32 and 40-42 under 35 U.S.C. 103(a) as being 
unpatentable over Herz et al . in view of U.S. Patent 5,758,259 to 
Lawler. In addition, the Examiner has rejected claims 6 and 30 
under 35 U.S.C. 103(a) as being unpatentable over Herz et al . in 
view of Lawler, and further in view of U.S. Patent 5,704,017 to 
Heckerman et al. Moreover, the Examiner has rejected claims 22 and 
45 under 35 U.S.C. 103(a) as being unpatentable over Herz et al . in 
view of U.S. Patent 6,005,597 to Barret et al . The Examiner has 
also rejected claims 11, 12, 34 and 35 under 35 U.S.C. 103(a) as 
being unpatentable over Herz et al . in view of Heckerman et al . 
Finally, the Examiner has rejected claims 49 and 50 under 35 U.S.C. 
103(a) as being unpatentable over Heckerman et al . 

Applicant acknowledges that the Examiner has allowed 
claims 51 and 52, and has found claims 7, 13-16, 20, 23-25, 31, 36- 
39, 43 and 46-48 allowable over the prior art of record. 
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In view of the above changes to the claims. Applicant 
believes that the Examiner's 35 U.S.C. 102(b) and 103(a) rejections 
of the claims have been overcome . 

Applicant believes that this application, containing 
claims 7, 8, 10-25, 31-48, 51 and 52, is now in condition for 
allowance and such action is respectfully requested. 

Respectfully submitted. 




Edward W. GoTodm^, Reg. 
Attorney 

Tel.: 914-333-9611 

CERTIFICATE OF MAILING 

It is hereby certified that this correspondence is being 
deposited with the United States Postal Service as First-class mail 
in an envelope addressed to: 

COMMISSIONER OF PATENTS AND TRADEMARKS 
P.O. BOX 1450 
ALEXANDRIA, VA 22313-1450 
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PHUS 000018 

♦ BAYECIAN A DAPTIVE TV SHOW -PROGRAM RECQMMENDER 

i^BACKGROUND OF THE INVENTION 
A^;— Field of Of the The Invention 

[0001] The invention relates to recommending television shows 
based on a user profile. 

5 

Bi— Description Of The Related Art 

[0002] -U.S. Pat. No. ent 5,758,259 shows a method for 
identifying a preferred television program based on a "correlation" 
10 between the program and predetermined characteristics of a user 
profile. The term "correlation" as used in the patent does not 
appear to relate to the mathematical concept of correlation, but 
ratherj_ is a very simple algorithm for assessing some similarity 
between a profile and a program. 

15 

II. SUMMARY OF THE INVENTION 

[0003] It is an object of the invention to improve techniques of 
automatic program recommendation. 
20 [0004] This object is achieved by using a probabilistic 
calculation, based on a viewer profile. The probabilistic 
calculation is preferably based on Bayesian classifier theory. 
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[0005] The object is further achieved by maintaining a local 
record of a viewer history. The local record is preferably 
incrementally updatable. The local record is advantageous for 
privacy reasons, and can be contrasted with methodSj^ such as 
5 collaborative filtering, which would require viewer history 
information to be uploaded to a central location. The use of 
incremental updates is advantageous in minimizing storage 
requirements . 

[0006] It is a still further object of the invention to improve 
10 the classical Bayesian classifier technique. 

[0007] In one embodiment, this object is achieved by noise 
filtering. 

[0008] In another embodiment, this object is achieved by 
applying a modified Bayesian classifier technique to non- 
15 independent feature values. 

[0009] Further objects and advantages of the invention will be 
described in the following. 

[0010] Bayesian classifiers are discussedj^ in general^, in the 
text-book of Duda & Hart, ^Pattern Recognition and Scene Analysis,;:. 
20 (John Wiley & Sons 1973) . An application of Bayesian classifiers to 
document retrieval is discussed in D. Billouo & M. Paggani, 
^Learning Probabilistic User Models", http ; //www. dkf i . uin 
Bb-r <aG/-bauGr/\im wo/Final VGroiono/BillouD/ProbUocrModclo . h fem^rbv D. 
Billsus & M. Pazzani. 

25 
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III. BRIEF DESCRIPTION OF THE DRAWING 
[0011] The invention will now be described by way of non- 



limiting example with reference to the following drawings-j__in 
which: 

5 [0012] Fig. ^1 shows a system on which the invention may be 
used-jL 

[0013] Fig. ^2 shows major elements of an adaptive 
recommender— j_ 

[0014] Fig. ^3 shows pseudo code for a viewing history 
10 generator— 

[0015] Fig. 3—4 shows a table of key fields-x 

[0016] Fig. 4—5 shows a viewer profile— j_ 

[0017] Fig. 5a — 6a shows a prior probability calculation— j_ 

[0018] Fig. 5b -6b shows a conditional probability calculation-^, 
15 and 

[0019] Fig. 5e — 6c shows a posterior probability calculation. 

IV. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
[0020] Fig ^1 illustrates hardware for implementing the 

20 invention. The hardware will typically havc includes a display l-t—j. 
some type of processor 2-f— , some type of user entry device 4 
connected to the processor 2 via some type of connection 3-^j_and 
some type of link 5 for receiving data, such as television 
programming or Electronic Programming Guide ("EPG") data. The 

25 display 1 will is commonly be— a television screen, but could be any 
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other type of display device. The processor 2 may be a oct set- top 
box, a PC, or any other type of data processing device, so long as 
it has sufficient processing power. The user entry device 4 may be 
a remote control unit and the connection 3 may be an infrared 
5 connection. If the processor is a PC, the user entry device will 
commonly be at least plural, e.g.j_ a keyboard and mouse. The user 
entry device may also be touch sensitivity on the display. The 
connection 5 to the outside world could be an antenna, cable, a 
phone line to the intcrnot lnternet , a network connection, or any 
10 other data link. Equally well, connection 5 could connect to a 
memory device or several memory devices. 

[0021] Fig. ^2 illustrates major elements of an embodiment of 
an adaptive recommender. These elements preferably reside as 
software and data in a medium 110 readable by a data processing 

15 device^ such as CPU 2 . The elements include a viewing history data 
structure 101 that gives input to profiler software 102. The 
profiler sof twarej_ in turnj_ produces the viewer profile 103 . The 
terms "user profile" and "viewer profile" shall be used 
interchangeably herein. The viewer profile serves as an input to 

20 recoramender software 104. The recommender software also uses, as an 
input, the EPG data structure 105, that contains features 
describing each show^^ such as title, channel, start time and the 
like. An output of the recommender 104 appears on a user interface 
106 where a user can interact with it. 
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[0022] Thio The v iewer history data structure includes selected 
records from the EPG database. Tho EPG databases are commercially 
available, for instancej_ from Tribune Media Services,^ Those of 
ordinary skill in the art may devise other formats, possibly with 
5 finer shades of description. The selected records minimally 

correspond to TV shows watched by the viewer. It is assumed that 
these records have been deposited in the viewing history data 
structure 101 by software that is part of the user interface and 
knows what shows the viewer has viewed. Preferably, the software 

10 would allows recording of a user watching more than one show in a 
given time interval, as users often de— switch back and forth during 
commercials^, and so forth. Preferably, also, the software records a 
program as watched regardless of how long it was watched; and if a 
show was watched or whether it was taped for later viewing. 

15 [0023] The preferred viewing history format assumes the presence 
of both positive and negative records in the viewing history. This 
is needed because the goal is to learn to differentiate between the 
features of shows that are liked and those not liked. Fig. 3—3 
shows pseudo code for collecting the viewing history. 
t0024] Let the notation C+ denote the set of positive (i.e., 
watched) shows and C- denote the negative (i.e., not watched) 
shows . 

[0025] The viewer profile includes a number of feature value 
counts . These counts will bo are incremented whenever new entries 
25 are deposited in the viewer history. Usually, each program will 



S : \GO\SS17GOB0 . RED 



5 



PHUS 000018 



havo has several feature values. Accordingly, the deposit of a 
program in the viewer history will causes the update of counts 
associated with all feature values associated with that program. 
[0026] The incremental updatability of this type of history is 
5 advantageous because it allows for ongoing adaptation of the viewer 
history without a large amount of storage or computing effort being 
required. 

[0027] In addition to the count of the number of positive and 
negative entries (k(C+), k(C-)), a count of occurrences of 

10 individual features will is also be— kept among the positive and 
negative examples (k{fi|C+), k(fi|C-)) where fi denotes feature i 
and k{fi|C+) denotes the number of shows in set C+ that possess 
feature fi. The feature set will includes entries in the EPG 
records extracted from selected key fields, an example of which is 

15 shown in Table 1 which is Fig, 3-4. 

[0028] A partial example of an embodiment of such counts is 
presented in tablo Table 2, shown in Fig. 4-5 to illustrate the 
idea. The list m — as p resented in the Figure in Fiq. 4 has six 
columns to save space, butj_ in factj_ the list has only three 

20 columns, with the later bottom p art of the tablc Table 2 being 

presented next to the oarlior top p art. Each row of the column Table 
2 has four pieces of data-; —, i.e., a feature type and a feature 
value in the first column, a positive count in the second column, 
and a negative count in the third column. The positive count 

25 indicates the number of times a program having that feature value 
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has been watched. The negative count indicates the number of times 
a program having that feature value has not been watched. 
[0029] A television program schedule normally includes several, 
if not many, programs for every time slot in every day. Normally, 
5 the user will only watch one or two of the programs in any given 
time slot . If the viewer profile contains a list of ALL the 
programs not watched, the niomber of programs not watched will far 
exceed the number of programs watched. It may be desirable to 
create a method for sampling the programs not watched. For 

10 instance, as the processor assembles the viewer profile, the 

processor may chose a single aefe ^not - watched program at random from 
the weekly schedule as a companion for each watched program, as 
suggested in the pseudo^code of Fig. SB, This design will attempt 
to keep the number of positive and negative entries in the viewing 

15 history about equal so as not to unbalance the Bayesian prior 
probability estimates, discussed below. 

[00303 It is not generally desirable to choose a companion 
program from the same time slot as a watched program. Experiment 
has shown that the combined time and day feature value is typically 
20 the strongest or one of the strongest predictors of whether a 

particular program will be preferred. ThuSj_ another program at the 
same time as the watched program may well be a second or third 
choice program, while a program at a totally different time may be 
very undesirable. Accordingly, it is preferred to choose the 
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companion program at random from the program schedule of the entire 
week that includes the watched program. 

[0031] Since time and day feature values for a program are often 
so important in determining whether a program will be of interest 
5 to a user, it is typically undesirable to consider two programs of 
identical content to be the same if they are shown on different 
days and/or at different times. In other wordSj_ a particular 
episode of a series may be strongly preferred if it is shown at 8 
p.m. on Tuesday, while the same episode of the same series may be 
10 completely undesirable if it is shown at 10 a.m. on Monday. Thus^ 
the episode at 10 a.m. should be considered a different program 
from the episode at 8 p.m., even though the content of the two are 
identical . 

[0032] As more and more shows are viewed, the length of the 
15 profile will tend to grow larger and larger. To combat this, and to 
keep the focus on features that are effective discriminators, the 
following are recommended: 

periodic reviews of the features in the viewer profile, 

and 

20 - removal of words that appear to be frequent and not very 

discriminating . 

[0033] In general, those of simple tastes, e.g.j_ those who only 
like to watch football, will be fairly easy to recommend for after 
taking of a viewer profile for a relatively short time. For those 
25 of more complex preferences, it will take longer for the viewer 
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history to be sufficiently meaningful to make good recommendations. 
These latter people, however, are those who are probably most in 
need of a recommendation. 

[0034] In the final analysis, viewer histories will always be 
5 ambiguous. Recommendations of shows based on such histories will 
always contain a margin for error. The recommendations canj_ at 
bestj_ be said to have some probability of being correct. Thereforej_ 
probabilistic calculations are useful in analyzing viewer profile 
data to make recommendations . 

10 [0035] The preferred embodiment of the recommender uses a simple 
Bayesian classifier using prior and conditional probability 
estimates derived from the viewer profile. How recommendations are 
shown to viewers is not defined here, yet it will be assumed that 
one can capture the viewer's response to them, at least observing 

15 whether or not they were watched. 

[0036] Belo w will be diocuoDcd ^ a 2 -class Bayesian decision 
model is discussed . The two classes of TV shows of interest are: 

( 

CI - shows that interest the viewer 
20 C2 - shows that do not interest the viewer 

Other classes might be used showing more shades of interest or lack 
thereof . 
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[0037] In contrast with the classes of interest listed above, 
viewing history obtains information only on the classes: 

C+ - shows the viewer watched 
5 C- - shows the viewer did not watch 

[0038] Determining which shows a user watched or did not watch 
is outside of the scope of this application. The user might enter a 
manual log of which shows g/hc he/she watched. Alternatively, 

10 hardware might record the user's watching behavior. Those of 

ordinary skill in the art might devise numerous techniques for 
this. It should be possible to consider shows as watched even if 
they are watched only for a short time, as a user may be switching 
back and forth between several shows, trying to keep track of all 

15 of them. 

[00393 Inferences may be made about classes CI and C2 based on 
observations, but these inferences will always contain an element 
of uncertainty. The Bayesian model will compute the prior 
probabilities P(C+) and P{C-) directly from the counts in the 
20 viewer profile in accordance with Fig. SetSa . In other words, the 
assumption will be that shows not watched are those the viewer is 
not interested in, and that the shows watched are the ones that the 
viewer is interested in, 

[0040] The conditional probabilities, that a given feature, fi, 
25 will be present if a show is in class C+ or C-, are then computed 
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in accordance with Fig. -Sfeeb. These calculations can be performed 
once a day during times that the TV is not being viewed and stored 
in the viewer profile. 

[0041] Recommendations for upcoming shows can be computed by 
5 estimating the posterior probabilities, i.e.j_ the probability that 
a show is in class C+ and C- given its features. Let x be a binary 
vector {xl, x2, „.,xi, xn) where i indexes over the features in 
the viewer profile^, and where xi = 1 if feature fi is present in 
the show being considered for recommendationj_ and 0 if not. For the 
10 exclusive features, like day, time, and station, where every show 
must have one and only one feature, the index i will be taken to 
indicate the value present in the show being considered^, provided 
that this value is also present in the profile. Otherwise, novel 
exclusive features will not enter into the calculations. For non- 
15 exclusive features, the index i will range over all values present 
in the profile; non-exclusive features novel to the considered show 
will not contribute to the calculations. The posterior 
probabilities are estimated in accordance with Fig. Se6c 
[0042] With these estimates in hand, a show will generally be 
20 recommended if P(C+|x) > P(C-|x) and the "strength" of the 

recommendation will be proportional to P{C+|x) - P(C-|x). One 
potential problem with this scheme is that some conditional 
probabilities are likely to be zero. Any zero in a chain 
multiplication will reduce the result to zero-ee ; hence, some means 
25 for eliminating zeros is needed. The Billsus and Pazzani article 
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referenced above j_ presents a couple of schemes, including simply 
inserting a small constant for any zeros that occur. 
[0043] One method for dealing with zeroes in the conditional 
probability multiplication chain would be as follows. One can 
5 choose a heuristic of 1000. If the number of shows in the viewing 
history is less than 1000, then the value of l/lOOO can be 
substituted for zero. If the number of shows in the viewing history 
is greater than 1000, the correction can be 



Where 

ki+ is the number of watched shows having feature I 
k+ is the total number of watched shows. 

This is what is called the Laplace correction in the Billsus and 
15 Pazzani article. This Laplace correction must also be done for the 

not watched shows . 

[0044] Alternative schemes may be devised by those of ordinary 
skill in the art. 

[0045] Classical Bayesian theory would require the use of all 
20 accumulated elements of the list of Fig. 4^5 in making a 

recommendation. Nevertheless, in some instances^, it may be useful 
to use a noise cutoff, eliminating features from consideration if 
insufficient data about them appears in the list. For instance^ if 
a particularly feature did not appear in more than some given 
25 percentage of shows considered, whether in negative or in positive 
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count, it might be ignored in determining which recommendation to 
make. Experimentally it was found that a cutoff of 5% was far too 
large . 

[0046] Rather than use a percentage, one embodiment of the noise 
5 cutoff would use the viewer profile itself to determine the cutoff. 
This embodiment would first take a subset, or sub- list, of the 
viewer profile relating to particular feature types. For instance, 
a sub-list might advantageously comprise all of the elements of the 
viewer profile relating to the feature types-? —, i.e.. time of day 

10 and day of the week. Alternatively, in another example, the sub- 
list might advantageously comprise all of the elements of the 
viewer profile relating to channel number. Generallyj_ the feature 
type or types chosen should be independent feature types, in other 
words^ feature types which do not require another feature type to 

15 be meaningful . 

[0047] The sub-list is then sorted by negative count, i.e,^ by 
number of shows having a particular feature value and not being 
watched. The highest negative count in this sorted list can be 
viewed as the noise level. In other words, since, in the preferred 

20 embodiment, the "not watched" shows are chosen at random from the 
week's program schedule, any not watched time slot can be 
considered to be noise. 

[0048] ThuSj_ any feature having both a positive and a negative 
count at or below the noise level need not be considered in the 
25 Bayesian calculation in making a recommendation. This example of 
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noise level thresholding hao uocd uses a particular feature, e.g.j^ 
day/time as one for determining noise cutoff. In general, any 
feature that is uniformly randomly sampled by the negative example 
sampling procedure may be chosen by those of ordinary skill in the 
5 art for the calculation of the noise threshold. 

[0049] The calculations of Figs. 5a6a-6c are advantageous in 
that they require fairly low computing power to complete and are 
therefore readily adaptable to modest hardware^, such as would be 
found in a act set- top box. 

10 

"Surprise Me" Feature 

[0050] Recommendations according to the above -described scheme 
will be programs having a preponderance of features that are 
present in shows that have been watched. The viewer profiles 
15 accumulated will not yield any meaningful recommendations with 

respect to shows having few features in common with watched shows. 
Accordingly, optionally, the recommender may occasionally recommend 
shows at random, in a "surprise me" feature, if such programs have 
relatively few features in common with watched shows, 

20 

Using The User Profile In Other Domains 

[0051] Once a user profile is developed, the recommendation 
techniques of the invention might be used to recommend other types 
of itemSj_ such as movies, books, audio recordings, or even 
25 promotional materials^, such as too tee- shirts or posters. 
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Non- Independence Of Features 

[0052] The classical assumption in the domain of Bayesian 
classifier theory is that all features are independent. Therefore, 
5 if a features is, say, often present in positive shows, but is 
missing from a show being considered for recommendation, the fact 
should count against the show. However, this may yield undesirable 
results for the current application. 

[0053] For example, let us assume that there are five day/time 

10 slots indicated in the user profile as being most watched. Let us 
assume further that a particular show being evaluated falls within 
one of those five slots. The calculation of Fig. ^e — 6c would then 
give rise to an increase in probability for the day/time slot that 
matches and a decrease for the four day/time slots that do not 

15 match. Intuitively, it appears that the latter decrease is not 

reasonably related to an accurate determination of probability for 
the show in question. The different values of day/time are not 
independent as every show has one and only one value, so the 
values a show does not have should not count against it. 

20 [0054] To remedy this deficiency in the classical Bayesian 

approach, it is proposed to designate features into two types: set 
Set 1 and oct Set 2 . If a feature is designated oct Set 1, the 
Bayesian calculation will ignore any non-matching values of the 
feature. If the feature is designated oct Set 2, then the normal 

25 Bayesian calculation, per Fig. Se6c, will be done. 
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[00553 Normally in a television application-& . S et 1 would 
include day/time; station; and title. Some features which have 
values only for a few shows, e.g.j_ critic ratings, should also be 
set 1, because too many shows would be non-matching merely because 
5 critics tend to rate only a tiny percentage of shows. 

[0056] Set 2, for television shows, would normally include all 
features that can have several values per show, such as actor. 
From reading the present disclosure, other modifications will be 
apparent to persons skilled in the art. Such modifications may 

10 involve other features which are already known in the design, 

manufacture and use of television interfaces and which may be used 
instead of or in addition to features already described herein. 
Although claims have been formulated in this application to 
particular combinations of features, it should be understood that 

15 the scope of the disclosure of the present application also 
includes any novel feature or novel combination of features 
disclosed herein either explicitly or implicitly or any 
generalization thereof, whether or not it mitigates any or all of 
the same technical problems as does the present invention. The 

20 aApplicants hereby give notice that new claims may be formulated to 
such features during the prosecution of the present application or 
any further application derived therefrom. 

[0057] The word "comprising", "comprise", or "comprises" as used 
herein should not be viewed as excluding additional elements. The 
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singular article "a" or "an" as used herein should not be viewed as 
excluding a plurality of elements. 
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VI. A BSTRACT OF THE DISCLOSURE 

A system for recommending television programs makes use 
of probabilistic calculations and a viewer profile to create a 
5 recommendation. The probabilistic calculations preferably are in 
the form of Bayesian classifier theory. Modifications to classical 
Bayesian classifier theory are proposed. 
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